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(57) Abstract: A map (MAP) is created from digital images, of an excised tissue specimen (20), obtained by confocal reflectance 
light microscopy (10) so that the orientation of the excised specimen and the location of tissue regions of interest, for example 
showing basal and squamous cell cancers for use in Moh's surgery can be indicated to the surgeon for use in the extirpation of the 
undesirable cells, such as malignancies. Images of slices (34) through the excised specimen can be obtained by confocal microscopy 
to obtain confocal maps which show the histopamology of the excision from a single excision, and without the need for slicing the 
excised specimen into sections for sectioning, dyeing, and coding of the regions of interest on an anatomic map, thereby reducing 
the time for detection of suspicious regions. 
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SYSTEM FOR OPTICALLY SECTIONING AND MAPPING 



SURGICALLY EXCISED TISSUE 



Description 



The present invention relates to systems for mapping surgically excised tissue 
specimens to correspond anatomically to the orientation of the excised tissue with respect to 
the patient from whom the tissue was removed, and particularly to a system for obtaining 
images by optical sectioning of a surgically excised tissue specimen and anatomically 
mapping these images. 

In certain surgical procedures, particularly those where specimens are excised for the 
determination of cancerous tissue, such as in Moh's micrographic surgery, considerable 
surgical time is occupied by histopathology in order to provide numerous frozen sections 
through the specimen which are assembled to produce maps of the excision showing the 
cancerous regions. Typically, two to four slices are excised in Moh's surgery and there is a 
waiting time from 10 to 30 minutes for the surgeon and the patient while each slice is 
processed using conventional histopathologic techniques, and maps of the excised tissue 
obtained to guide the surgeon in the removal of the cancerous tissue with minimal damage to 
normal tissue. 

It is the principal feature of this invention to utilize optical sectioning, especially with 
the aid of images obtained from confocal microscopy, to provide mapped images (anatomical 
maps) of the excised tissue specimen in a fraction of the time required by conventional 
histopathology thereby enabling the detection of cancers within minutes rather than hours. 

Briefly, the system (which includes the method which carries out optical sectioning 
and mapping of surgically excised tissue specimens) may utilize a macroscopic imaging 
means for capturing a multi-spectral full field macroscopic image of the excised tissue which 
has been placed in a cassette marked with respect to the orientation of the excised tissue with 
respect to the patient. The imaging means captures images either by white light reflectance or 
fluorescopic imaging techniques or with confocal imaging means (see U.S. Patent No. 
5,788,639 or 5,880,880). A translation stage may be coupled to the cassette for moving it in 
orthogonal directions such that different parts of the specimen may be presented to the 
objective of the imaging means. The objective of the imaging means is translatable in a 
direction orthogonal to the directions of translation of the stage so as to image different slices 
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on or within the specimen. A two-dimensional image block may be obtained by two- 
dimensional scanning of a beam on, or inside, the specimen. A map of the image blocks may 
be formed by scanning in a serpentine stepwise motion of the cassette with respect to the 
objective or vice versa. A single image block represents a map element. Each block is 
identified by a row and column in the bit map and the image of each block is digitally stored 
in memory and may have a pointer associated with each block. By compression, such as with 
a median filter, a compressed composite image is obtained and stored in memory. A mosaic 
of the map elements constitutes a full resolution image. A frame may have a group of these 
elements of the mosaic and thereby displays the image in high resolution sufficient for the 
physician to locate regions of interest, for example, containing cancerous cells. The 
composite image is a macroscopic image of compressed or reduced resolution, for example, 
one pixel per map element obtained by pixel elimination, mean-value-substitution or median 
filtering, the latter being preferred. A frame containing the composite, compressed image or 
selected blocks of the full resolution mosaic can be displayed either alternately or in different 
windows of a screen to the physician. The display shows those blocks in the region which are 
marked, as by a user interface or mouse, on the composite macroscopic image. At any time 
different slices may be displayed. The regions of the high resolution image may be marked 
by dots of different colors or patterns as may be defined in a look-up table, such as red for 
cancerous, green for non-cancerous and yellow for uncertain, on the display. The information 
appears on the macroscopic image as to the location of the potentially cancerous regions and 
may be used by the surgeon in making further excisions for removal of the cancerous cells. A 
complete two-dimensional image with the markings and the map all oriented with respect to 
the patient (the anatomic map) may be displayed, if desired. The images in any frame either 
of the composite or of the map elements from the mosaic may be printed out on a color 
printer, or the entire two-dimensional image may be displayed. 

The foregoing and other features advantages and improvements provided by the 
invention as well as a preferred embodiment thereof will become more apparent from a 
reading of the following description in connection with the accompanying drawings and also 
in connection with International Publication WO 00/49392, published 24 August 2000 of 
International Application PCT/US00/04070, claiming priority to U.S. Patent Application 
Serial Number 60/120,534, filed 17 February 1999, showing a cassette for an excised tissue 
specimen which may be suitable for use in practicing the invention, as well as mechanisms 
for handling the cassette and confocal images. The aforesaid International Publication also 
may be instructive with respect to the background of the invention, especially in connection 
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with Moh's surgery. This publication is incorporated herein and made part hereof. Another 
International Publication WO 00/55669, published 21 September 2000, is incorporated herein 
by reference. This publication is of International Application PCT/USOO/07008, which 
claims priority to U.S. Patent Application Serial Number 60/125,033, filed 1 8 March 1999. 
The later International Publication describes confocal imaging means especially suitable for 
use in practicing the invention which uses cross-polarization and acetic acid to enhance 
imaging. 

The drawings, briefly described, are as follows: 

Fig, 1 is a block diagram of a system for optically sectioning and mapping surgically 
excised tissue, which embodies the invention; 

Fig. 2 is a plan view of the cassette which contains the excised tissue specimen and 
which is shown on a stage in Fig. 1 ; 

Fig. 3 is a view similar to Fig. 2, but with the specimen mounted in the cassette with 
the deep margin up, the deep margin being oriented to face the objective of the confocal 
imaging system; 

Fig. 4 is a perspective view of the cassette showing the lid of the cassette down with 
the cassette cover being closed, the cassette cover being the portion of the cassette adjacent to 
the objective lens in Fig. 1, and the specimen being placed on the lid in the center thereof, and 
the cassette cover, which contains a plate or window which compresses the specimen, in the 
open position; 

Fig. 5 is a showing of the serpentine path of the scan, the raster across the specimen 
and individual elements which make up the mosaic of elements of the high resolution or 
mosaic image; 

Fig. 6 is a view showing the clipping limits or vignetted part of an image elements 
from which an image of the element is taken so as to remove blurring or reduce intensity at 
the image margins; 

Fig. 7 is a block diagram showing the relationship between the composite 
macroscopic image and the specimen, and the map of the image as shown on the composite, 
the figure also showing a block of map elements within an image frame, the map elements 
being indicated on the diagram of the composite image, and the figure also showing how the 
block is marked by indicating the neoplasm shown therein as being cancerous, non-cancerous 
or uncertain or ambiguous as to its cancerous or non-cancerous nature; 
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Fig. 8 is a view of the composite image showing blocks which have been marked as 
being cancerous but flipped to reflect the orientation in the patient which is deep margin 
down rather than up; 

Figs. 9 A, 9B and 9C constitute a diagram of the flow chart of the method carried out 
by the system of Fig. 1, the figures are assembled at the connectors (x) and (x) and (y) and 

(y); 

Fig. 10 shows a complete dermal/epidermal margin and its location on the specimen; 

and 

Fig. 1 1 is a view similar to Fig. 10, but showing an incomplete dermal/epidermal 

margin. 

Referring to Fig. 1, there is shown a confocal imaging system similar to the system 
shown in Fig. 14 of the above-referenced International Publication WO 00/49392. The 
system uses as its imaging means a confocal microscope 10, preferably having the 
polarization and acetic acid image enhancement facilities of the above-referenced 
International Publication WO 00/55669. The objective (objective lens 12) of the microscope 
is equipped with a focus control input 14, which may physically move the objective up and 
down to focus at a horizontal section (slice) within an excised tissue specimen in a tissue 
cassette 16. The cassette 16 is mounted for X and Y movement (that is in a horizontal plane), 
as shown by the coordinate system 18, on a translation stage 20. It may be operated by a 
remote control 22 which provides inputs to a controller 24 connected to the microscope 10. 
The controller 24 receives the reflected signal from the specimen, provides scanning signals 
so as to scan the specimen and create the mosaic image. Signals are provided to the stage 20 
via a translator line, marked "cassette position control", and to the objective 12 via a focus 
control line. The laser power control for controlling the power from the laser in the 
microscope is indicated by the connection marked "laser power". 

The controller 24 receives inputs from a computer 26 and the remote control 22. The 
imaging algorithms are carried out in the computer 26. The computer 26 provides serial 
communications over a bus for controlling the scan. It also receives a pixel clock, a line 
clock and a frame clock which marks the pixels individually and the lines and entire frame of 
the mosaic as they are contained in the reflected signal. The computer 26 creates the 
composite macroscopic image as well as the mosaic of map elements and stores them in 
memory together with their associated pointers. The image may be outputted to a network for 
telepathology at a remote source, or even over the Internet, via a network interface indicated 
at 28. Control for identifying map elements, which are to be viewed in separate frames and to 
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switch between windows or the same window for viewing the composite and high resolution 
frames is obtained by user input 30 which may be implemented as a "mouse" or with a touch 
screen. The image is printed out on a printer 32 or may be viewed on a terminal or display 34 
with the high resolution image in the center frame window and the composite image as a map 
in a corner window. Soft controls 36 on the display 34 are also provided for marking or for 
viewing different sections or slices of the specimen. 

Fig. 2 shows the bottom or lid of the cassette 16. It shows a mark 54 at the top which 
indicates the head or top center of the head (superior margin) of the patient. There are marks 
56 or blocks indicating five, ten, fifteen and twenty millimeter regions all concentric with 
each other, as shown in Fig, 3. The cassette 16, as shown in Fig. 4, has a lid 38 and a cover 
plate 40 which when closed compresses the specimen 42. 

Fig. 5 shows the mosaic of individual image fields or map elements which are created 
by scanning in X and Y step wise across a region which contains the specimen 42. The scan 
is called the "mosaic trajectoiy". Only the individual map elements or image fields across the 
first or top traverse of the scan are shown to simplify the illustration. In processing the image 
the signals may be limited at boundaries Y and X so as to vignette the image thereby 
removing areas at the boundary which may not be unambiguously digitized in the computer, 
as shown in Fig. 6. 

In one embodiment, the controller 24 which receives the reflected signals (either gray 
scale or in color of the tissue) determines a continuous outer boundary of the tissue shown in 
the image by first thresholding each of the pixels of the image. The pixels above the 
threshold are stored as "Is" in a bit map, while all other bits are stored as "0". The area of the 
bit map is divided into the blocks shown as the individual image fields in Fig. 5. The area of 
these blocks may constitute 80% to 100% of the field of view of the confocal imaging system, 
which may be from 0.4 to 1.0 millimeters. An "exclusive-or" operation may be performed in 
the controller on the bits of each block of the bit map, which if the operation results in a "1" 
for any block, identifies that block as being contained inside the boundary line of the tissue 
against the window. The bit map forms a map of the tissue in contact with the window or 
other horizontal slices further away from the window (in the z direction). 

An example of the information displayed on the display 34, for a particular case, is 
illustrated in Fig. 7. 

The mosaic maybe 15 by 15 individual image blocks or frames, where each frame is 
stored as 640 by 640 pixels. For example, a mosaic is shown at 50 in Fig. 7. 
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The region containing four image blocks or map elements is selected, via the controls 
by viewing the macroscopic image. The region is enlarged and shown at 58, displays in high 
resolution four blocks of the image mosaic. From this high resolution image the cancerous 
cells can be detected by the physician (the pathologist) who observes the confocal image on 
the display 34 or on a display which is coupled via the network 28. Then the neoplastic 
condition can be identified by using the controls 36 and marked on the display or map in 
different patterns or colors; red for cancerous, green for non-cancerous and yellow for 
uncertain. Image maps shown at 55, 52, and 57 in Fig. 7 are marked cancerous, non- 
cancerous and uncertain, respectively. It will therefore be apparent that there is a complete 
anatomical map of the specimen, as well as images of sufficient resolution to detect cells 
which are neoplastic. 

It may be desirable to flip the image 180 degrees to reflect the orientation of the 
patient; that is deep margin down, rather than up, as the image is actually mounted in the 
cassette and viewed by the confocal microscope 10 (see Fig. 1). The flipped composite image 
with cancerous areas marked is shown in Fig. 8. This image serves as a tumor map and can 
be used to guide subsequent excisions. 

Referring to Figs. 9A, 9B and 9C, the method and algorithm for carrying out the 
invention is illustrated. Fig. 9A illustrates the tissue loading and imaging phase, while Figs. 
9B and 9C illustrate the image formation and display phase, respectively. 

First the tissue is excised from the patient in the step of removing the tissue 60. The 
tissue is marked to indicate the tissue orientation with respect to the patient by the physician. 
That is, the superior margin toward the head of the patient is important as well as the lateral 
or sides of the excise specimen. This step is shown at 62. The tissue specimen is then placed 
on the lid 38 of the cassette 16 with the deep margin facing up, as shown in Figs. 3 and 4. 
The superior margin faces the indicia 54. This step is shown at 64. 

The specimen is placed on the lid 38 inside the marked grid of the lid. The cassette 
cover then is closed and imaging fluid, for example the acetic acid, is inserted into the 
cassette around the specimen. This step is shown at 66. 

The user inputs the size of the largest grid which circumscribes the specimen. This is 
the grid 56 shown in Fig. 3. This provides a tissue size input which is used in creating the 
mosaic of map elements as shown in Fig. 5. The size of marking step is indicated at 68. The 
specimen in its cassette 16 is then mounted on the stage by placing it on the receptacle 
indicated at 55 in Fig. 1 . The loading step is shown at 70. 
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The remaining steps of algorithm and the operations to obtain the image are apparent 
from Figs. 9B and 9C. The X, Y and Z parameters of the map are inputted automatically 
from the controller at 80. The translator (translation stage) position which corresponds to the 
center of the cassette is programmed into the controller, initially. The focus is then adjusted 
5 by the user to obtain the slice or depth (in z) of interest for the particular image at 82, such as 
with focus control input 14. The stage is then sent home to a start location at 84. The 
serpentine scan is then carried out at 86. Each map element is then stored in memory. Since 
there are many bits, disk memory may be used. See 88. The clipping or vignetting of the 
image step is next carried out at 90. Then the composite or macro image is obtained either by 

io pixel elimination, mean value substitution or median filtering and saved in bit map, DICOM 
format or similar format at 92. At 94 the composite is displayed, this may be in the main 
window or in the side window on display 34. The user then clicks with the mouse on the 
composite to a desired X, Y location and the four map elements at the X, Y location are 
displayed in the main window. This is step 96. In this manner, the four map elements 

15 provide a high resolution image to the user which was stored in memory at step 88. 

Optionally, the user may select to view live images of the specimen in a window on the 
display with the confocal microscope imaging of specimen at a desired X-Y location, and the 
user may manipulate imaging, such as by changing focus (depth) or laser power of the 
confocal microscope, or may move the translation stage with respect to the objective lens of 

2 o the confocal microscope about that X-Y location. The pathologist then marks the image as a 
mapped section of the specimen which has cancerous cells. The margins of the specimen are 
thoroughly investigated and all cancerous regions marked for further excision and removal 
during the latter stages of the surgery. The marking step is shown at 96 A. If a map button is 
clicked on the display 34, the composite map is again displayed at step 94, and steps 96 and 

2 5 96 A may be repeated at the same or different X-Y location on the composite map. The 

mapping described above may be reactivated (repeated) for the specimen if any setting of the 
confocal microscope, such as focus, laser power, or other imaging parameter, is changed at 
step 98A. After the specimen is examined, a complete two-dimensional image with the 
markings and the composite map all oriented with respect to the patient may be outputted to 

3 o the display 34 or color printer 32. 

An important aspect of Moh's surgery is that the entire margin of the specimen is 
imaged. Fig. 10 shows a complete dermal/epidermal margin. The corrugated line in Fig. 10 
represents the interface between the epidermal layer and the dermal layer. Fig. 1 1 shows an 
incomplete dermal/epidermal junction. The cause for an incomplete junction is due to tissue 
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lifting from the imaging window 40. If the physician were to see image blocks as shown in 
the expanded region of Fig. 1 1, the physician should mark the region as "uncertain" and 
investigate the area with live images focusing higher into the tissue until the entire boundary 
is imaged. This insures that a projection of cancer has not evaded detection. 

From the foregoing description it will be apparent that there has been provided an 
improved system for sectioning and mapping surgically excised tissues via confocal 
microscopy so as to obtain macro displays suitable for marking and micro displays 
corresponding to specific sections of the macro display, from which the nature of the tissue 
can be determined on a microscopic level. Complete anatomical maps may be provided or 
the images may be viewed in live form, as is conventional in confocal microscopy, thereby 
providing the pathologist with extreme flexibility in carrying out histopathological 
examinations and especially detecting cancers. In the preferred embodiment confocal 
reflectance microscopy is used to provide images with sufficient resolution in order to allow 
pathological screening or diagnosis. Other imaging modalities could be substituted for the 
reflectance confocal microscope. Examples of alternative imaging modalities include, optical 
coherence tomography, multi-photon microscopy or high frequency ultrasound. In-vivo 
mapping of the lesion is also possible by using an in-vivo reflectance confocal microscope to 
image the surgical field rather than an excised specimen. These and other variations and 
modifications in the herein described system will undoubtedly become apparent to those 
skilled in the art. Accordingly, the foregoing description should be taken as illustrative and 
not in a limiting sense. 
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Claims 



1. 



A system for optically sectioning and mapping a surgically excised tissue 



specimen comprising: 

means for providing data representing a mosaic of elements of an image of the 
specimen; and 

means for viewing a macroscopic composite image of the specimen and microscopic 
images of selected elements of the mosaic at selected locations on the composite images. 

2. The system according to Claim 1 further comprising means for providing 
anatomical maps of the specimen with areas containing cells which are cancerous marked to 
direct further surgical operations. 

3. The system according to Claim 1 wherein said data providing means 
comprises a laser scanning confocal microscope. 

4. The system according to Claim 1 wherein said data providing means includes 
means for providing data respecting a plurality of said images each corresponding to a 
different slice of said specimen, and said viewing means is operative to view a composite 
image and microscopic images of each of said slices. 

5. The system according to Claim 4 wherein said data providing means includes 
means for scanning said specimen and providing said mosaic on each said slice during each 
of a plurality of scans. 

6. The system according to Claim 1 wherein said viewing means includes means 
for displaying a plurality of frames containing said macroscopic image and blocks of adjacent 
ones of said elements which constitute at least one of said microscopic images. 

7. The system according to Claim 3 wherein said confocal microscope has a 
stage, a cassette removably containing said specimen mounted on said stage and an objective 
lens, said lens and stage being movable with respect to each other along X-Y-Z coordinates 
during said mapping. 
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8. The system according to Claim 1 wherein said data providing means includes 
means providing data representing the orientation of said specimen with respect to a patient 
from which said specimen is excised. 



9. A method of optically sectioning and mapping tissue for histopathology 
comprising the steps of: 

capturing an anatomic map of elements constituting a full field representation of a 
region of said tissue which constitutes a specimen; 

storing data representing a plurality of pixels constituting each of said map elements 
and orientation of said specimen with respect to a patient; 

displaying in response to said data a composite macroscopic image of said full field 
containing all of said pixels; and 

displaying microscopic images of selected blocks of said elements of sufficient 
resolution to show portions of said specimen containing cells of interest. 

10. The method according to Claim 9 wherein said capturing step is carried out 
with the aide of a laser confocal microscope while scanning said specimen in a plurality of 
planes thereby providing a plurality of composite images and high resolution microscopic 
images for each of said composite images. 

11. The method according to Claim 9 further comprising the step of marking areas 
of said composite image corresponding to said blocks to indicate the histopathological 
characteristics of said blocks apparent from the microscopic images thereof. 
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Tissue Loading and Imaging 




Annotate tissue to indicate tissue 
orientation with respect to patient: ie 
lateral and superior margins 



62 



Race tissue on lid of tissue cassette, deep 
margin facing up with superior margin toward 
indicia on tissue cassette lid. 



.64 




Center perimeter of tissue inside marked grid 
of tissue cassette lid. 
Close cover. 
Add tissue imaging fluid 



66 




Input size of marking 
rectangle which 
circumscribes tissue: 
TISSUE SIZE 




68 



Load keyed tissue cassette into 
imaging system. 
Intiate imaging. 



70 




FIG. 9 A 
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Obtain starting location (x,y,z) and dimension of 
map (now required to be square) as well as clipping 
offsets -x, X+, -y f y+. 



Operator adjusts focus to desired depth into 
tissue and sets laser power. 



Move stage to START STAGE LOCATION. 



Move stage in serpentine motion capturing one frame at a t 



ime. 



X 



Save each image to memory and disk. 



Af ter ail images are captured build composite map using clipping 
limits -x, x+, -y, y+ 



I 



Form composite image by pixel elimination or median filtering 
Save composite at 64 0x640 x 8-bit gray (in BMP or DICOM 
format) and also save a patient information file. 
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84 



86 



88 



90 



92 



Display composite in main window 
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User may click on composite image to reference a x,y location to 
move stage and display live image. User may move tissue abou t 
this location, change focal position, or change laser power. 



Af ter reviewing image block the user can mark an image block as 
non-cancerous, cancerous, or uncertain. All image blocks are 
reviewed. Uncertain blocks are checked with live imaging. 



I 



If the map button is clicked, go back and display composite map. 



Mapping is reactivated if any setting is changed. 
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96A 
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